Adaptive multi-modal fusion hashing via Hadamard matrix
نویسندگان
چکیده
Hashing plays an important role in information retrieval, due to its low storage and high speed of processing. As effective multi-modal representation learning method, hashing has received particular attention. Most the existing methods adopt fixed weighting factors fuse multiple modalities for any query data, which cannot capture variation among different queries. Besides, there are too much hyper-parameters their models while it is time-consuming labor-intensive determine proper parameters. The limitations may significantly hinder promotion practical applications. In this paper, we propose a simple, yet method that inspired by Hadamard matrix. On one hand, our proposed involves very few flexible. other complementary between data semantic discrimination preserved well hash codes. Extensive experimental results on four benchmark datasets show framework achieves superior performance compared state-of-the-art methods.
منابع مشابه
Probabilistic Semi-Supervised Multi-Modal Hashing
In this paper, we propose a non-parametric Bayesian framework for multi-modal hash learning that takes into account the distance supervision (similarity/dissimilarity constraints). Our model embeds data of arbitrary modalities into a single latent binary feature with the ability to learn the dimensionality of the binary feature using the data itself. Given supervisory information (labeled simil...
متن کاملAdaptive Multi-modal Sensors
Compressing real-time input through bandwidth constrained connections has been studied within robotics, wireless sensor networks, and image processing. When there are bandwidth constraints on realtime input the amount of information to be transferred will always be greater than the amount that can be transferred per unit of time. We propose a system that utilizes a local diffusion process and a...
متن کاملSoft multi-modal data fusion
Clustering groups items together that are most similar to each other and sets those that are least similar into different clusters. Methods have been developed to cluster records in a data set that are of only qualitative or quantitative data. Data sets exist that contain a mix of qualitative (nominal and ordinal) and quantitative (discrete and continuous) data. Clustering records of mixed kind...
متن کاملMulti-modal decision fusion for continuous authentication
Active authentication is the process of continuously verifying a user based on their on-going interaction with a computer. In this study, we consider a representative collection of behavioral biometrics: two low-level modalities of keystroke dynamics and mouse movement, and a high-level modality of stylometry. We develop a sensor for each modality and organize the sensors as a parallel binary d...
متن کاملBayesian Fusion for Multi-Modal Aerial Images
This paper presents a fusion method to combine aerial images from a low flying Unmanned Aerial Vehicle (UAV) with images of other spectral bands from sources such as satellites or commercial hyperspectral imagers. The proposed method propagates information from high-resolution images into other low-resolution modalities while allowing the images to have different spectral channels. This means t...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Applied Intelligence
سال: 2022
ISSN: ['0924-669X', '1573-7497']
DOI: https://doi.org/10.1007/s10489-022-03367-w